DOCUMENT RESDMB 



ED 077 987 



TM 002 798 



AUTHOR 
TITLE 

INSTITDTION 

REPORT NO 
PUB DATE 
NOTE 

EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Moodie, Allan G. ; Hoen, Robert 

Evaluation of DISTAR Programs in Learning Assistance 

Classes of Vancouver 1971-72. 

Vancouver Board cC school Trustees (British 

Columbia) • Dept. of Planning and Evaluation. 

RR-72-18 

Jul 72 

15p. 

MF-$0.65 HC-$3.29 

♦Achievement Tests; Arithmetic; Elementary Grades; 
♦Instructional Systems; Language Instruction; 
Mathematics Instruction; ♦Program Evaluation; 
Questionnaires; Reading Instruction; Remedial 
Instruction; ♦Teacher Attitudes; ♦Test Results 
♦Metropolitan Achievement Tests 



ABSTRACT 

DISTAR programs were used in learning assistance 
classes at five Vancouver schools during 1971-72. Those pupils who 
were taught with the DISTAR Arithmetic program made sizable gains in 
scores on the Arithmetic subtest of the Metn^politan Achievement 
Test^ but the difference between the gains made by experimental and 
control groups in arithmetic was not statistically significant. 
Control groups were not available in the evaluation of DISTAR Reading 
and Language achievement. Those pupils taught with DISTAR Reading 
programs made sizable gains on the "word Knowledge,** "word 
Discrimination," and "Reading" subtests of the Metropolitan Test. The 
DISTAR Language pupils made good progress as measured by the 
"Reading" subtest but not on the "Word Knowledge" and "Word 
Discrimination" subtests. Taped interviews with DISTAR Language I 
pupils showed no noteworthy changes in spoken language. Teachers • 
opinions of DISTAR were very favorable. Observations of DISTAR 
classes showed that the teachers' use of DISTAR was consistent with 
the program's direction. Observations also yielded the impression 
that children enjoyed DISTAR. The study did not provide any objective 
support for DISTAR, but in view of the strong subjective support and 
acknowledging the limitations of the study, further consideration of 
DISTAR 's value is recommended. (Author) 



us OEPARTMENTOFHFALTH. 
EOUCATION a WELFARE 
OFFICc OF EDUCATION 

THIS DOCUMENT HAS BEEN REPRO 
OUCED EXACTLY AS RECEIVED FROM 
THE PERSON OR ORGANIZATION ORIG- 
INATING IT POINTS OF VIEW OR OPIN 
IONS STATED DO NOT NECESSARILY 
REPRESENT OFFICIAL OFFICE 07 EDU 
CATION POSITION OR POUCY 



RESEARC H REPORT 



Evaluation of DISTAR Programs in 
Learning Assistance Classes of 

^Vancouver 1971-72 

July, 1972 
Allan G. Moodie 
Robert Hoen 
Research Report 72-18 



Department of Planning and Evaluation 
Board of School Trustees 
1595 West 10th Avenue 
Vancouver 9» B* C. 



FILMED FROM BEST AVAILABLE COPY 



o 



UJ 

EVALUATION OF DISTAR PROGRAMS IN LEARNING ASSISTANCE 
CLASSES OF VANCOUVER 1971-72 



July, 1972 
Allan G. Moodie 
Robert Hoen 
Research Report 72-18 



This study is an extension of the "Evaluation of 
DISTAR Materials in Three Junior Learning 
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EVALUATION OF DLSTAR PROGRAMS IN LEARNING ASSISTANCE 
CLASSES OF VANCOUVER 1971-72 



Abstract 



DISTAR programs were used in learning assistance classes at five Vancouver 
schools during 1971-72. 

Those pupils who were taught with the DISTAR Arithmetic program made 
sizable gains in scores on the Arithmetic subtest of the Metropolitan 
Achievement Test, but the difference between the gains made by experimental 
and control groups in arithmetic was not statistically significant. Control 
groups were not available in the evaluation of DISTAR Reading and Language 
achievement. Those pupils taught with DISTAR Reading programs made 
sizable gains on the "Word Knowledge", "Word Discrimination", and "Reading- 
subtests of the Metropolitan Test. The DISTAR Language pupils made good 
progress as measured by the "Reading" subtest but not on the "Word 
Knowledge" and "Word Discrimination" subtests. Taped interviews with 
DISTAR Language I pupils showed no noteworthy changes in spoken language. 
Teachers' opinions of DISTAR were very favourable. Observations of DISTAR 
classes showed that the teachers' use of DISTAR was consistent with the 
program's direction. Observations also yielded the impression that children 
enjoyed DISTAR. 

The study did not provide any objective support for DISTAR; but in view of 
the strong subjective support and acknowledging the limitations of the study, 
further consideration of DISTAR's value is recommended. 
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introduction 



The Direct Instructional System for Teaching and Remediation (DISTAR)^ 
contains programs for teaching the basic skills and concepts in reading, 
.anguage and arithmetic. It has developed from the basic assumptions 

LllcL L ■ 

1. Children learn what they are taught; 

2. The necessary basic skills and concepts are the same for all 
children; 

3. It is possible to teach all of these necessary skills and concepts 
by means of a suitable instructional program. 

The development of various DISTAR programs has included; 

- a thorough task analysis of the subject area, 

- a logical programming of task components, 

- a prescription of teaching routines incorporating correction 
procedures, 

- an emphasis on reinforcement techniques, and 

- an incorporation of testing (which is used as a teaching aid as 
well as a means of determining what the children have been taught). 

The system is designed for small groups and requires the maximum 
participation of each child, thus providing the benefits of .ndividual instruction 
with maximum instantaneous feedback to the teacher. Emphasis is constantly 
placed upon the idea of success rather than failure. ^ 

AH.T.^^/' ^ R«^di"g I and II. Language I and II. and 

niann'". A Programs. Level III programs in each subject are also 

planned. Approximately one year's time is required for a typical group to 
complete one level of a program; however, some groups of children may 

WH^ V. I ""^'^ ^"^ """^ ^ ^^^^^ "^°^i"g into the next 

level), while others may require more than a year to complete a level. 

Case studies of the effects of DISTAR have been conducted by the program's 
developers, by the publisher (Science Research Associates), and by 
ir,tr T^\°^ program. Many of these case studies have been 

bfthe a2' W- °' ^^'^''^'^ development has been studied 
by the American Institute for Research. 
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T?a^ct^a aI^T^"??^' interpreted to be "Direct Instructional System for 
leaching Arithmetic and Reading". 
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The Program in Vancouver 

During 1971-72 the following DISTAR programs -^ere used in learning 
assistance classes at five schools (an increase of two schools from the 
previous year): 

Arithmetic I - Emily Carr Elementary School 

Arithmetic I and II - Sir James Douglas Annex 

Language I - General B rock Annex 

Reading I - Lord Elementary School 

Reading I and II - Henry Hudson Elementary School 

The Arithmetic II and Reading II programs were introduced at the two schools 
which participated in the DISTAR I programs in 1970-71. 

Evaluation Pupils' A chievement in Arithmetic. Reading, and Written 
Languag e 

The Primary I and II Batteries of the Metropolitan Achievement Test were 
administered in pre- and post-test sessions to measure the chances in 
achievement of the DISTAR pupils. Pre- and post-test scores for each subtest 
were transformed into grade equivalents. 



Statistical "t" tests were used to determine if the differences between the 
mean scores for the experimental group using each DISTAR program were 
signiucantly different from that for a control group. 

For the evaluation of Arithmetic I and II, achievement was measured by: 

1. the Arithmetic Concepts and Skills subtest in the Primary I 
battery, or 

2. the combined Computation. Concept and Problem Solving subtests 
in the Primary II Battery of the Metropolitan Achievement Test. 

The analysis of results on these tests appears in Table I. Most of the DTSTAR 
pupils made sizable gains in the scores on the Metropolitan Tests between 
the pre-test and post-test sessions. The difference between the gains mad- 
by experimental and control groups was not statistically significant 
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TABLE I: ANALYSES BY "t" TEST OF METROPOLITAN ACHIEVEMENT 
SCORES FOR SPECIAL EDUCATION PUPILS ON THE DISTAR 
ARITHMETIC I AND II PROGRAMS AS COMPARED TO THOSE 
ON OTHER DISTAR PROGRAMS 





Metropolitan Achievement Test 




Arithmetic Concepts and Skills 




Experimental 
Group 


Contr:)l 
GrouD 


Number of Subjects 

Mean Gain in Grade Equivalent 

Standard Deviation 


14 
0. 07 
0. 26 


24 
0. 13 
0.48 


Difference Between Means 
"t" Value 


- 0. 

0. 


06 

43 (r.s. d.) 



Legend: (n. s. d. ) no significant difference 



TABLE II: MEAN GAINS IN GRADE EQUIVALENT SCORES ON METROPOLITAN 
ACHIEVEMENT TESTS FOR SPECIAL EDUCATION PUPILS ON 
THE DISTAR LANGUAGE I AND READING I AND II PROGRAMS 





M 


etropolitan Achievement 1 

W^^j T-»; 1 i _ 


rest 




Language 
I 


Reading 
I & II 


TIT U XVIBC 

Language 
I 


1 iimnaiion 
Reading 
I & II 


Kej 
Language 
I 


iding 
Reading 
I & II 


Number of Subjects 
Mean Gain in Grade 

Equivalent 
Standard Deviation 


7 

0. 04 

^ 0. 24 


!1 

0.39 
0. 55 


6 

- 0.05 
0. 57 


11 

0. 52 
1.02 


6 

0.27 
0. 19 


11 

0.35 
0. 38 



For the evaluation of the Language I and of the Reading I and II DISTAR 
programs, achievement was measured by the Word Knowledge, Word 
Discrimination and Reading subtests in the Primary I or Primary II Battery 
of the Metropolitan Achievement Test (See Table II)\ 

For *^he evaluation of achievement by pupils on the DISTAR Language I 
program and by pupils on the DISTAR Reading I and II programs it was not 
possible to establish control groups. For the Language and for the Reading 
groups the mean gains in grade equivalent score on the Metropolitan 
Subtests are listed in Table 11. It will be noted that the Reading group made 
sizable gains on all three subtests. The Language group made good progress 
on the Reading subtest and little or no progress on the other two subtests. 

Pupils' Achievement in Spoken Language 

Achievement in spoken language is important to a study of DISTAR, but 
particularly difficult to evaluate. An attempt was made to evaluate changes 
in the spoken language of the children who were taught with the DISTAR 
Language I materials. The children were interviewed as a group in October, 
March, and June, and the dialogues were recorded on tape. Untortunately, 
technical problems prevented the last of the three interview recordings from 
being utilized. There were four children who participated in both the 
October and the March interviews. Their responses are transcribed in 
Appendix A. Aside from some improvement in the children's willingness 
to speak, no noteworthy changes in spoken lL,nguage were found from these 
interviews. No definite conclusions should be drawn, however, from these 
few data. 



Responses of DISTAR Teachers to a Questionnaire 

A questionnaire devised by Lynne Guinet in 1971 was administered again 
this year. (See Appendix B). 

The following positive opinions were held by all, or by four, of the five 
teachers: 



- I like the DISTAR system. (4 teachers) 

- I would like to teach another DISTAR subject. (4 teachers) 

- Most of the children like DISTAR. (4 teachers) 

- Most of the children pass the tests in the books. (4 teachers) 

- I would like to use DISTAR again. (4 teachers) 

- If I had more help, I would like to use more than one DISTAR system 
in my class. (4 teachers) 

- I like the highly structured nature of the DISTAR systems. (4 teachers) 

- I think it is a good way to teach. (4 teachers) 

- The children are learning the DISTAR material, (5 teachers 

- Very poor students seem to be improving.. (4 teachers) 

- I feel confident teaching DISTAR. (4 teachers) 

- My preparation to teach DISTAR was adequate. (4 teachers) 
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Of the negative responses that were possible in the questionnaire, only 
the following were made by as many as 3 of the 5 teachers: 

- I need more help in the classroom. (3 teachers) 

- A few children are bored with repeating lessons. (3 teachers) 

- One or two children seem to hold up the group, i. e. , perform 
poorly or disturb the class. (3 teachers) 

It is noteworthy that the teachers' responses were quite consistent with 
those found by Lynne Guinet. 

Class Observations 

One of the writers was able to observe four of the five classes using DISTAR 
The purposes of the observations were: 

1. to find out whether the teachers were using the DISTAR materials 
as directed by the program's creators, and 

2. to gather impressions of how the children responded to the program. 

The teachers' use of the DISTAR materials was consistent with the program's 
tlltTTu"" I °! observed. With few exceptions, the teachers 

closely followed the highly structured DISTAR procedures. The program's 
emphasis on particular procedures for correcting errors and for reinforcing 
desired responses was quite faithfully implemented. In all of the classes 
In^^y^ \ " instructed in small groups (ranging from 4 to 8 

members); and in every case, the teacher saw to it that each child participated 
frequently. Slight differences were found among the four teachers fn the 
LTnH I 7^';,"""°"' case was any doubt raised in the observer's 

mind as to the appropriateness of the pace. Some differences were also 

lr22f. ^" °^ liveliness and enthusiasm 

brought to the lessons, but all four teachers led the lessons adequately in 
this respect. n^a.'-^iy 

Lfr '^^"u.' f'^^'''^^' °f the DISTAR children obviously enjoyed 

their lessons. With few exceptions, the children's attention lasted throughout 
and they were eager to do the workbook exercises after the oral part of the 
lesson was completed. Many of the children took pride in their competence to 
respond quickly and correctly. competence to 

Conclusion 

lyiLTX^Z^Tj^^^^ '"^ f ^r""^ DISTAR Instructional 

bystem. It should be emphasized, however, that the study has severe 

oTmSTrP remembered that strong subjective support 

recommended" * "^"'"'^ ^'"'^ °' ^^^"^ °^ ^^^^^^ - °- 
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APPENDIX A 



TRANSCRIPTION OF THE INTERVIEW RESPONSES OF FOUR DISTAR 
LANGUAGE I PUPILS IN OCTOBER 1971 AND IN MARCH 1972 



TRANSCRIPTION OF THE INTERVIEW RESPONSES OF FOUR DISTAR 
LANGUAGE I PUPILS IN OCTOBER 1971 AND IN MARCH 1972* 



CHILD #1 
October 

Interviewer: What are we going to do in the Halloween party ? 

Child: We're going to cook hot dogs, and - urn - we're going to have 
cookies and pop. 

Interviewer: What is your mask going to be ? 

Child: Um - . . . it's going to be a mask with a party hat on it. 

Interviewer: What are you going to be sure you do before vou rook ? 

Child: Um - we're going to put our apron on and then we're going to cook. 

March 



Interviewer: Wltat did you like about the art gallery? 

Child: The - the pictures and . . . and . . . and the sisters . . . and . . . um . . . 

and the stuffed mummy. 

Interviewer: What picture did you like best? 

Child: Um - the one where they were getting married. 

Interviewer: What did you do last week? 

Child: Um. . . I went and saw - um - some - went to a show with my 
family, and I saw some Eskimo irawings, and . . . and I 
"Hansel and Gretel", 



saw 



*The transcription is not intended to give a running record of the dialogue 
w/fo'T'^' recorded here are taken from a group interview and organized 



ERIC 



CHILD #2 
October 

Interviewer: What are we going to do with the hot dogs ? 

Child: Oh - ah - sell them . 

Interviewer: What is your mask going to be ? 

Child: A monster. 

Interviewer: What are the boys going to do ' ^ . give out the hot dogs 
Child: Wash their hands . 

/ March 

Interviewer: What did you like about the art gallery ? 

Child: The doors, and - uh - that ... that picture what moves, and, ... 
that . . . that white thing, that guy. 

Interviewer: What did you do last week ? 

Child: (No answer) 

Interviewer: What did you do on Saturday ? 

Child: Last Saturday? Went out and . . . (no further response) 
Interviewer: Did you go out with someone? 
Child: Yeah, 

Interviewer: Tell us about it. 
Child: (Nc answer) 

Interviewer: Now he remembers what he did . 

Child: I went to a movie and I saw a lot of snow. . . and lots of ice in the 
house ... uh . . . get killed - uh - a whole bunch of blood. 



CHILD #3 
October 

Interviewer: What elee are we going to have besides hot dogs and p op? 
Child: Popcorn. 

"ntp'/iewer: What are w e going to do with the hot dogs and pop ? 
Child: Give them out. 

Interviewer: What are yo u going to do before you start cooking ? 
Child: (No answer) 

March 



Interviewer: What did you like about the art gallery? 

Child: The pictures. . . and - uh - that thing what was laying on that thing. . . 
that dead thing. . . and that stuffed lady. 

Interviewer: What have you done lately ? 

Child: We went out . . . and then we went to our cousin's. 

Interviewer: Did you stay for dinner ? 

Child: No . we left at twelve . . . then we went to our . , . another cousin's 
and I slept over. 

CHILD H 
October 

Interviewer: What are we going to line up for at the p ^vty? 
Child: Um - a party. 

Interview /er: What is your mask t/oing to be ? 
Child: A clown, 

(No ansv er given to other questions asked. ) 



CHILD #4 (Continued) 
March 

Interviewer: What did you like about the art gallery? 

Child: That ... the pictures . . . and . . . that dead guy . . . that - um - 
whatever . . . that dead person . . . and that stuffed - uh - well 
that stuffed . whatever it's called. 

Interviewer: What did you do last week ? 

Child: I went to the boat show, and you could see boats, and - uh - then 
you had races. 

Interviewer: Weren't there some animals there too ? 

Child: Yeah, there was a donkey or a horse, but it was . . . and . . . and , 
they showed you how to saddle the donkey, the right way . . . and 
there's these - uh - how to cook out . . . and then there's these - u 
goldfish you could take home. 
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SUMMARY OF RESPONSES TO TEACHER QUESTIONNAIRES, 
SPRING. 1972 
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^Summary of Responses to Teacher Questionnairea, Spring, 1972 

A questionnaire, designed by Lynne Guinet in 1971, was given in 1972 

to the five teachers using DISTAR. The responses are summarized below. 

Questionnaire to DISTAR Teachers 

1# Is the daily half-hour lesson 

a) a reasonable length? 3 

b) too long? 1 

c) too short? 

-no response 1 



Z. Do you find it difficult to keep the children's attention? 

a) no more difficult than on other work 4 

b) more difficult than on other work 1 

3. Do you have an aide in the classroom? a) yes_l b) no 3 

no response 1 

4* Do you need more help? a) vea 3 M i 

d; yes J b) n o 1 no response 1 

5. Have you modified the DISTAR system you teach? 

a) quite a lot 

b) slightl y 3 

c) not at all 1 



no response 1 

6. Are all the Take -Homes effective as rewards? 

a) yes 2 

b) no 

c) I have changed the Take-Homes to make them mora effective 1 
a) don't use them 1 



no response 1 



7. Do you teach DISTAI^ every day? 

a) almost always 4 

b) irregularl y 1 

8. Have you changed the instructions or formats? 

a) always follow the boo k 1 

b) have made a few changes 4 

c) have made many changes 

9* Do you like the DISTAR system? 
a) yes 4 b) no 1 



c) no opinion^ 
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10. Would you like to teach another DISTAR subject? 

^) b) no c) no opinio n 1 

11. In your opinion, could parts of the DISTAR systems, e. g. . sound 
blending exercises, counting drills, be used in any class? 

L_ b) no c) don't kno w 

12. Do you think DISTAR is superior to most other methods for teaching 
slow learners? DISTAR is a) a better method 3_ 

b) about the same as other methods 1 

c) not as good as other methods 1 

13. Do the children like DISTAR? 

a) most of them like i t 4 

b) some do and some don't 1 

c) most of them dislike it 



14. 



Have comments from parents about DISTAR generally been 

a) favourable? 3 

b) unfavourable ? 

c) no comments 2 



15. 



Are tests in the program a good guide to the progress children are making? 
a) yes 2 b) n o 2 c) don't kno w 1 

16. Are many children bored with repeating lessons? , 

a) man y 1 b) a fe w 3 c) none 1 

17. Do one or two children seem to hold up the group, i. e. . perform poorlv or 
disturb the class? a) yes 3 b) no 2 

18. Is DISTAR easy to use? a) easy 3 b) of average difficulty 1 

c) difficul t 1 " 

19. In comparison to other lessons. DISTAR preparation takes 

a) more time 1 b) less time 1 c) about the same 

amount of time 3 

20. How do the children progress? 

a) Most of them pass the tests in the books 4 

b) Some of them pass the tests in the books 1 

c) F ev of them pass the tests in the books_ 



21. Would you like to use DISTAR again? 

a) yes_4__ b) n o_ 1 c) no opinion 

22. If you had enough help, would you like to use more than one DISTAR 
system in your class? 

ERIC a) ye8_JL. b) n o 1 c) no opinion_ 
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23. Do you feel a special class would benefit from having all three 
DISTAR systems? 

a) yes 2 b) no 1 c) don't know 2 

24. Does DISTAR teach what you want it to teach? 

a) yes 2 

b) no 

c) teaches some things and omits others 3 

25. Does DISTAR seem to work equally well for all your children? 

^) yes 3_ b) no 2 c) don't know 

! 

If not, with which children does it work best? 
- those with better attention spans 2 

26. The DISTAR systems are highly structured- -same formats, signals, 
patterned responses from students. Do you like this structure? 

^) 4 b) no no response 1 

Do you think it is a good way to teach? 

a) yes__4 b) no 1 don't know 



27. Are the children learning the DISTAR material? a) yes 5 b) no 

28. Do your very poor students seem to be improving? 

^) ye8_4 b) no c) don't know 1 



29. Do you feel confident teaching DISTAR? 

a) yes _4 b) no 1 c) no opinion 

30. Was your preparation ^o teach DISTAR adequate? a) yes_4 b) no 

no response 1 



